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Abstract 

-^ Relative entropy is an essential tool in quantum information theory. There are so many 

problems which are related to relative entropy. In this article, the optimal values which are 

defined by max S(UpU* II u) and min S(UpU* II c) for two positive definite operators 

UeU(x d ) UeU{x d ) 

p,cr 6 Pd(A') are obtained. And the set of S(UpU* \\ a) for every unitary operator LI is full of 
r/3 ■ the interval [ min S(UpU* II cr), max S(UpU* II c)l. 

Q ■ U€U{X d ) UeU(X d ) 
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(N . 1 Introduction 

O 

In complex Euclidean spaces X, one writes L (X ,y) to refer to the collection of all linear map- 
pings of the form A : X — > y, denote \^{X ,X)hyh{X), an operator A G L (X) is normal if and 
only if it commutes with its adjoint: [A, A*] , or equivalently AA* = A* A. An operator is positive 
semidefinite A G L (X) if and only if it holds that A = B*B for some operator B G L (X). The 
collection of operators is denoted Pos(A') = {B*B : B G L (X)}. The notation P > is also used 
to mean that P is positive semidefinite , while A > B means that A — B is positive semidefinite. 
A positive semidefinite operator P G Pos(A") is said to be positive definite if, in addition to being 
positive semidefinite, it is non-singular. We write Pd(< ; f) = {A G Pos(A') : det(A) ^ 0} to denote 
the set of such operators for a given complex Euclidean space X. 

An unitary operator A G L (X,y) is a linear isometry if it preserves the Euclidean norm- 
meaning that || Au || = || u || for all u G X. The condition that || Au || = || m || for all u G X 
is equivalent to AA* = \%. The collection of unitary operator is denoted \1{X ,y) = {A G 
L(^,^):AA*=1^}. 
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Theorem 1.1 (Spectral Theorem([lJ)). Let X be a complex Euclidean space, let A G L (X) be a normal 
operator, and assume that the distinct eigencalues of A are X\,..., A&. Then there exist an orthogonal basis 
{x\, %2, ■ ■ ■ , x n } of X, such that 

k 

A = Y J K*iA- 
i=\ 

von Neumann entropy and relative entropy are powerful tools in quantum information the- 
ory. The quantum relative entropy(or relative von Neumann entropy) is indispensable as a tool 
for the von Neumann entropy. 

For two positive definite operators P,Q G ¥&{X), then the von Neumann entropy of P is 
defined by 

S(P) d = f Tr(Plog(P)), 

the quantum relative entropy between P and Q is defined by: 

S(P || Q) =Tr(Plog(P))-Tr(Plog(Q)) / 

we take the base 2 logarithm of corresponding eigenvalues. Specifically when im(P) C kerQ, we 
define S(P \\ Q) = oo. 

Let B = [bij] be a N x N bi-stochastic matrix, that is, ty; > 0, and 

for each i,j = 1, ... , N. We only consider finite-dimensional complex Hilbert spaces, let r,sG R n , 
r is majorised by s, written as r ^ s, if 

k k 

X><2>, l<k<n-l 

1=1 ;=1 

and 

n n 

i=l ;=1 

2 Description of the problems and main results 

For two positive definite operators P,Q G Pd(A') / here dim(A^) = d. We try to find the optimal 
values which are defined by 

max S(UpU* II a) and min S(UpU* II c) 
U6LT(> rf ) ueu(A' rf ) 



respectively. Since 



and 



max S(UpU* II a) = —Sip) — min Tr(LZpLZ*log(j) 
ueu(x d ) r ' yr/ ueu(x d ) 



min S(UpU* II c) = — S(p) — max Trffipfi* loeu) 

Thus the above optimal problems are reduced to the followings: 

max Tr(UpU*logcr) and min Tr (UpU* log a) 
ueu(x d ) ueu(x d ) 

Firstly, we assume that supp(p) C supp(<j) and a is of full rank. By the spectral decomposi- 
tion, we have that 

T = E A y(^)ly;>(y;l=E A J(^)l z ;>< z ;l- 

;' ;' 

For an orthonormal basis {|y/)} of X d and \y^) = |z^ +1 _fc) for k G [d] = {1, . . . ,d}. Here A|(c) 
stands for eigenvalues are arranged in decreasing order and AT(c) stands for eigenvalues are 
arranged in increasing order. If [p, a] ^ 0, from the spectral decomposition of p: 



P = E A j(p)\ x i)( x i\' 



where {|x,-)} is an orthonormal basis of X&, we know that there exist two unitary operators 

U,V : U = Y^\yj)(xj\ and V = ^ \zj){xj\, such that U\xj) = \yj) for each /, respectively. 
i i 

Now 

Tr(l7pLTlogcr)=X>j(p)logAJ(<r) 
;' 
and 

Tr(VpV*loga) = £ A}(p) log A ; V). 

i 

In mathematics, the rearrangement inequality states that 

x n yi + ...+ xiy„ < x n{1) yi + ...+ x n[n) y n < x x y\ + ... + x n y n (2.1) 

for every choice of real numbers 

X\< ... <x n and y\ < ... <y n , 

and every permutation x n <\\,. . •,x n < n ) of X\ < ... < x n . If the number are different, meaning 
that 

X\ < ... < x n and y\ < ... <y n , 



then the lower bound is attained only for the permutation which reverses the order, i.e. n(i) = 
n — x : + 1 for all i = 1, . . . , n. 

Note that the rearrangement inequality makes no assumptions on the signs of the real num- 
ber. 



is 



Lemma 2.1. Let x^,y^, u^ G R d , all having their coordinates in decreasing order. Ify^^t, x^, i.e. y^ 
majorized by x^, then 

(ir^y^) < (u^,x^). 

Proof. For the completeness, we give the detailed proof. We make an induction argument in the 

following. 

& d 

We denote the Tr(x^) = Tr(y^) = s, i.e. , s = Y^ xt = Y^ yr.If d = 2, by a simple algebra, we 

have 

(u^y^) < (u^,x^). 

In fact, 

2 2 

E x t u t - E 44 = ( s 4 + 4(4 - ( s 4)) - ( s 4 + 4(4 - 4)) = (4 - 4) (4 - 4) > ° 

Where the last line in the above inequality holds because y^ is majorized by x^, i.e. , 

4>4' s = jy = jy. 

/' ;' 

Next we suppose that the inequality holds for d — 1. Now we show that the inequality holds 
for d. 

E 44 - E 44 = E(4 - y}) (4 - 4) > (4-i - 4) E(4 - 4) > o 

7=1 ;=1 ;=1 ;=1 

The proof is completed. D 

Remark 2.2. The result obtained in Lemma 2.1 can be reformulated as:For two fixed d-dimensional 
real vector x^, u^ £ R d , we have 

max(u^ I B I x^) = (u^.x^), 
B 

where the above optimization is taken over the set of all bi-stochastic matrices of size d x d. 



By employing the rearrangement inequality we have that, for any permutation n G Sj, 
EA}05)logA}(cr) > £>}(,*) log A^cr) > £\j(p) log Aj(cr). 



Thus from the above discussion , it is seen that the above questions are reduced to the case 
where [p, a] = and a > 0. 

Now we can make an assumption: 

i i 

where AJ(c) > for each j. We still show that 



ma> :Tx(UpW log a) = £>}(?) logAJ(<r) (2 2) 

ueu(x d ) j v > 



mm Tr(UpU*log(r) = £AJ-(p)logAj(cr) (23) 

Now for any unitary operator W G U(X^), 

Tr(WpW*logcr) =^AJ-(p)logA|(cr)| </|W|/) | 2 . 



Setting D = [| (/| W|z) | ], we see that D is a bi-stochastic matrix since D = W oW, where o is 
Schur product. 

Now we have Tr( WpW* logcr) = J^\j(p)ocj, where «/ = £ I </| W|z> | A|(p) = X]D,-, ; a}(». 

;' ' « 

This indicates that 

a = D^(p), 

where 

a =[«!,..., a rf ] T and A^(p) = [A}(jo),. . ./A^jo)] 7 , 

which implies that 

a. -< A ; (p). 

Therefore 

Tr( WpW* log a) = (logA^lDlA^jo)), 

where log \±(p) = [logA}(p),... / logAj(p)]T. 



In what follows, we show that 

max Tr (WpW* log &) = max(log A i (p)\D\A i (p)). 
ueu(x d ) D 

It follows from Lemma 2.1 that 

max<logA+(p)|D|A+(p)> = (logA^(p), A^)) = £ Aj (p) log A j(<r). 

7=1 

Thus we are arriving at the following conclusion: 

Theorem 2.3. Let X be a complex Euclidean spaces and assume that p,o~ G Pd(X) are positive definite 
operators on X. Then 

max S(UpW || a) = -S(p) - (logA^),A+(p)). 

U<=U(X d ) 
Similarly, we have 

Theorem 2.4. Let X be a complex Euclidean spaces and assume that p,o~ G Pd(X) are positive definite 
operators on X. Then 

min S(UpU* || a) = -S(p) - <logA+(p),At(p)). 

UeU(X d ) 



3 Further result 

In this section, the value range of S(UpU* \\ o~) is discussed. We define the following sets 
M{p,a) = {S{UpU* || o) : U G ii(A" rf )}, M(p,cr) = {Tr(UpUV) : 17 G U(X d )} 

If the set M(p,(7) is the interval 

f min S(UpU* II cr), max S(UpU* II <r)l 
ueu(;r d ) Lfeu(^) 

it is equivalent to the following: 

M = [ min Tr(UptfV), max Tr(tfptfV)l 

l UeU(X d ) r UeU(;r d ) 

Theorem 3.1. Lef X be a complex Euclidean spaces and assume that p,a G Pd(A") are positive definite 
operators on X. If we define the following sets 



then 



M{p,cr) = {Tr(UpU*cr) : U G U{X d )}, 



M(p,a) = [ min TriUpWcr), max Tr(UpU*a)] 
ueu{x d ) u^u(x d ) 



Proof. This problem is equivalent to 
M(p,a) = [ mm Tr(lTpZIV), max Tr(UpUV)] = [£ Aj(p) log Aj(<r),£ AJ"(p) log AJ-(tr)]. 

It d = n we assume that A^(p) = (Ai,. . .,A n ) and A^(c) = {ji\,. . .,^ n ).Then the problem is 
equivalent to 

n n 

M{p,a) = Ea^„_ /+1/ £]a ; ^]. 



;=1 



/=1 



We make an induction argument in the following. And we only need consider the diagonal 
form of p and a for any unitary what's more, the value on diagonal are arranged in decreasing 
order. 

Firstly if d = 2, the problem is equivalent to M(p,o~) = [Aif/ 2 + A 2 ^i, Ai^i + A 2 f/ 2 ] for \\, A2 
and }i\,}i2 are eigenvalues of p, a G Pd(A") , respectively. For any A: G [0,1] , there exists unitary 
U, such that 

U 1 + (l-fc)A 2 vWT^lAi - A 2 )~ 
a/AVI-^Ai - A 2 U 2 + (1 - fc)Ai 



LZpLf* 



where 



Then 



LI 



\fk VT^k 
VT^k -\[k 



,k£ [0,1]. 



Tr(UpUV) = [(l-fc)A 2 + fcAi]pi + [U 2 + (l-fc)Ai]p 2 

= (l-/c)(Ai J M2 + A 2 f/i) +fc(Ai^i +A 2 f/ 2 )- 



It is equivalent to Tr(UplTV) is convex combination of Ai^ 2 + A 2 f/i and Ai^i + A 2 ^ 2 - There- 
fore, when d = 2, M(p,cr) = [Ai^ 2 + A 2 ^i,Ai^i + A 2 f/ 2 ]- 



Next we suppose that the conclusion holds ford = n — 1, i.e. if d = n — 1, 

M(p,a) = [EAt(p)logAT( ( r) / £At(p)logAt((r)] = £ A,-p B _ f/ 1) A,-# 

1=1 !=1 1=1 1=1 

where A^(p) = (Ai,...,A„_i) and A^(cr) = (>i,. . .,^„_i). 
Now we should to prove the conclusion holds for d = n. 



(3.1) 



From (2.1), we know that 



i=\ 

> A 2 /^i + A 1; w 2 + A 3j u 3 + . 

> A 2 //l + A 3j M 2 + Aif/3 + . 

> ... 

> A 2 ji\ + A 3j w 2 + A 4j w 3 + . 

> A 2 ^i + A 3j w 2 + A 4j «3 + • 



+ Kjin 

+ Kjin 

+ Kjin 

+ Kjin-l + Kjin 
+ Kjin-l + Kjin 



For the first inequality, 

Ai^i + A 2 /^ 2 + A 3j u 3 + . . . + A„/*„ 
> A 2 ^i + Ai^ 2 + A 3j w 3 + . . . + A„^„ 

there exists an unitary U, for any k G [0,1], such that 

fcli + (l-fc)A 2 \/Jfc\/T^Jfc(Ai - A 2 ) 

Vk~VT^k(K - A 2 U 2 + (1 - fc)Ai 

A 3 

A 4 



UpU* 















where 



U 



\fk ^/T^k 

^/T^k -Vk 

£ 

and £ is Unit matrix. 

n 

This is equivalent tod = 2, thus Tr(UpU*cr) be full of the interval [Aj^ 2 + Kji\ + Y] Kji-i, Kji\ 








Am 



«'=3 



A 2 ^ 2 + 53 Aj^,-]. Therefore T^UplPc) be full of the interval 



!=3 



fc— 1 n fc— 1 n 

[X] A ; -+i^ + Ai^fc + K+iVk+i + J2 hV-i'Yu K+iVi + K+iH + KVk+i + X] A,-^ 

i=l i'=fc+2 !=1 j'=fc+2 



where fc G {!,...,«}. 



Thus Tr( UpWa) be full of the interval 



n— 1 n— 1 

[X] M+lHn-i + M}*n, X] A i+lF* + A lj"n] ( 3 - 2 ) 



From (3.1) we know that if d = n — 1, for A^(p) = (A2, ■ • •/ A„) and A^(y) = (ui, . . . ,f/„_i),we 

n—1 n — 1 

have M(p,a) = [^ A,-+i^ n _j, ^ A !+ i^,].Then when d = n , Tr(UplTV) be full of the interval 

! = 1 1 = 1 

n— 1 n— 1 

[I] ^i+l^n-i + A lF«' I] A /'+lF/' + A l/^]- 
j=l t=l 

According to (3.1) and (3.2) , Tr(UpU*(r) be full of the interval 

n—\ n—1 n—\ n—1 

[I] K+lVn-i + Mu n , Y^, ^i+lHi + Mjin] U [ J^ ^i+lFn-i + Mj*n, J^ Aj+i^j + Ai^„] 
j=l j=l j=1 i=l 



Therefore Tr(UplTV) be full of the interval 



j=l j=l 1=1 j=l 



According to (2.2) and (2.3) , 



max Tr(UpUV) = £ A }(p) A j(<r) = £>,■?,■ 



and 



n 



min 1 Tr(UpUV) = EWW = E A ^n-m- 



n 



Therefore M(p, a) = [£ KY-n-i+ii YL ^iV-i\- ^ ne P ro °f is completed. □ 

j=i j=i 

Therefore we have 

M(p,cr) = [ min S(UpU* II c), max S(UpU* II <r)l 

UGU(A" rf ) r U<=U(X d ) 

= [S{p) - <A+(p),logA^)),-S(p) - <A^),logAt(p))]. 



Then S(UpU* II cr) be full of the interval [ min S(UpU* II cr), max S(UpU* II cr)l. 

iiGU(A" rf ) r UGU(A" rf ) 



4 A generalization 

In fact, the above two optimal problems can be easily generalized as follows: 

Given two operators p, a G Pd(A') are positive definite operators on X. If co ~< p, then 

max I 'min{S(co \\ cr) : <x> -< p} = max/min{S(<&(p) \\ a) : Obi-stochastic} 

Thus we have 

max S(0(p) || a) = -S(p) - (A^logA^)) 

<P bi-stocnastic 



and 



If we denote 



min S(0(p) || a-) = S(p) - (A^(p),logAHp)>. 

<t> bi-stocnastic 



M(p,a) = {S(<D(p) || a) : O bi-stochastic} 



Similarly, we have 

M{p,a) = [S{p) - (\±(p),log\i(p)),S(p) - (\i(p),logtf(p))]. 
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